The rate of entropy increase at the edge of chaos 
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(~| . Under certain conditions, tiie rate of increase of tiie statistical entropy of a simple, fully chaotic, 

O ' conservative system is known to be given by a single number, characteristic of this system, the 

O , Kolmogorov-Sinai entropy rate. This connection is here generalized to a simple dissipative system, 

' the logistic map, and especially to the chaos threshold of the latter, the edge of chaos. It is found 

^+ ' that, in the edge-of-chaos case, the usual Boltzmann-Gibbs-Shannon entropy is not appropriate. 

^ Instead, the non-extensive entropy Sq = — qli^ ' , must be used. The latter contains a parameter 

^ . q, the entropic index which must be given a special value q* ^ 1 (for q — 1 one recovers the usual 

' entropy) characteristic of the edge-of-chaos under consideration. The same q* enters also in the 

, description of the sensitivity to initial conditions, as well as in that of the multifractal spectrum of 

■ the attractor. 

a^ : 
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I ■ The connection between chaos and thermodynamics has been receiving increased attention lately. A review of the 
' O central ideas can be found in Recent studies have focused on both conservative (classical long-range interacting 
^ many-body Hamiltonians low-dimensional conservative maps |^]) and dissipative (low-dimensional maps 

many-body self-organized criticality |^], symbolic sequences [Q) systems. In ref. the connection between the 
Kolmogorov-Sinai (KS) entropy rate and the statistical entropy (or thermodynamic entropy) was brought out for 
. 5^ \ simple conservative systems. In ref. the non-extensive entropy introduced some years ago by one of us jsj was 
. shown to be the relevant quantity at the chaos threshold {the edge of chaos). This entropy contains a parameter q 
which has been called the entropic index and it reduces to the usual Boltzmann-Gibbs-Shannon (BGS) entropy when 
. . . g = 1. In refs. [t|J5l q was determined in two completely different ways: from the sensitivity to initial conditions and 



o 



from the multifractal spectrum (using 1/(1 — g) = 1/amin — ^/oLmaxi where amin and Umax are respectively the lower 
and upper values where the multifractal function /(a) vanishes). 

The purpose of this letter is to extend the work of |^ to a dissipative case and to focus especially on the edge of 
chaos. The results are: 1) In the chaotic regime the linear rate of the BGS entropy gives the KS entropy; 2) At the 
edge of chaos, the non-extensive entropy for one particular value q ^ 1 grows linearly with time, as did the usual 
entropy in 3) The value of q thus determined at the edge of chaos is identical with that found with the two other 
independent methods respectively used in refs. [Q and 
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The dissipative system chosen is the simplest possible: the logistic map, a nonlinear one-dimensional dynamical 
system described by the iterative rule 

xt+i = l-ax'^ (-1 < < 1; < a < 2; t 0, 1,2, ...) . (1) 

It has chaotic behavior (with a positive Lyapunov exponent) for most of the values of the control parameter a above 
the critical value Uc = 1.40115519.... This critical value marks the edge of chaos. 

For convenience, we recall here the definition of the non-extensive entropy [^j. If the phase space TZ has been 
divided into W cells of equal measure, and if the probability of being in cell i is pi, we define the entropy Sq by 

Sq^ ~g Y^' il^T^)- (2) 

For q — 1 this is 5i = — ^DiliPt 1^ Pi^ the usual entropy. This generalized entropy was proposed a decade ago ||] to 
allow statistical mechanics to cover certain anomalies due to a possible (multi)fractal structure of the relevant phase 
space (for example, whenever we have long-range interactions, long-range microscopic memory, multifractal boundary 
conditions, some dissipative process, etc). A review of the existing theoretical, experimental and computational 
evidence and connections is now available (very recent verifications in fully developed turbulence and in electron- 
positron annihilation producing hadronic jets are exhibited in ||l^ and [0 respectively). We also recall the two main 
results of refs. The first one |^ concerns the sensitivity to initial conditions. In a truly chaotic system, the 

separation between nearby trajectories, suitably averaged over phase space, ^{t) diverges in time like the exponential 
exp (Xit), where Ai > is the Lyapunov exponent. At the edge of chaos, on the other hand, the upper bound growth 
of the separation follows a power law which may be written 

e(t) (X [l + (l-q)Xqt]T^ (qen) (3) 

in terms of a certain parameter q. The exponential is recovered in the limit q = I. For the logistic map at the edge 
of chaos, the Lyapunov exponent Ai is found to vanish, but the growth of the separation is fitted well by eq. (H) 
with q = q* = 0.2445.... The second result concerns the geometrical description of the multifractal attractor existing 
at Uc- See ref. |^ for details. This gives a different method for finding a special value of q which fits the results, and 
this value turns out to be again 0.2445. 

The power-law sensitivity to the initial conditions has already been noticed in the literature JTsf . We shall refer to it 
as weak sensitivity, as opposed to the exponential law which we call strong sensitivity. The weak case is characteristic 
of the edge of chaos. The conclusion which seems to emerge from our work is that the various manifestations of the 
edge of chaos all contain in their description a certain parameter q* , which has the same value for all of them; and 
that moreover this q* is the entropic index which must be used (instead of the usual value 1) in a thermodynamic 
description of an edge-of-chaos system. 

We shall now present the numerical work we have done, in which q* is calculated in a third, completely different 
way, which involves rates of increase of entropies. We use the analysis developped in ref. for conservative systems. 
In order to do so we partition the interval — 1 < x < 1 into W equal cells; we choose (randomly or not) one of them 
and we select (randomly or uniformly) N values of x (inside that cell) which will be considered as initial conditions 
for the logistic map at a given value of a. As t evolves, the N points spread within the [—1, 1] interval in such a way 
that we have a set {Ni{t)} with X]i=i = ^ ^^'^d a set of probabilities {pi{t) = Ni{t)/N}. Differently from 

ref. 1^ , we consider here the general entropy (^ , which for q = 1 reduces to the entropy used in ^ . 

At t ~ 0, all probabilities but one are zero, hence Sq{0) — 0. And, as t evolves, Sq{t) tends to increase, in all cases 

bounded by ^ {InW when q = 1), which corresponds to cquiprobability. Fluctuations are of course present 

and can be reduced by considering averages over the initial conditions. As last step, we define the following rate of 
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where ki, in the case of chaotic conservative systems, is expected to coincide with the standard KS entropy rate 
Our expectations, based on the work of refs. |^jl^, are: 

(i) A special value q* exists such that Sq'>{t) increases linearly with time. Kq is then finite for q = q*, vanishes for 
q > q* and diverges for q < q* . 

(ii) When the system is strongly sensitive to initial conditions (Ai > 0), g* is 1 and the results of ref. [|j can be 
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extended to dissipative systems. 

(iii) At the edge of chaos (Ai = 0, weakly sensitive systems), q* is different from 1 and coincides with the value 
determined from the sensitivity to initial conditions (eq.(^)) and from the multifractal spectrum. 
The following results confirm these expectations. 

In fig. 1 we present the case a = 2, for which the system is chaotic (with Ai = In 2 ), and then we expect q* — 1. We 
show the time evolution of Sq for three different values of q . Only the curves for q = 1 show a clear linear behavior 
before we reach the asymptotic constant value which characterizes the equilibrium distribution in the available part 
of phase space. The slope in the intermediate time stage does not depend on W and it is equal to the KS entropy 
rate In 2 (for any one-dimensional system the KS entropy is given by the positive Lyapunov exponent p4|). This is 
clear in fig. 2 which shows Si{t) for two different cases a — 2 and a = 1.6 . In both cases the fitted slope agrees with 
the predicted KS entropy rates, respectively In 2 and 0.3578 . 

So far we have shown that q* is 1 for all the cases in which the logistic curve is chaotic, i.e. strongly sensitive to 
the initial conditions. Now we want to study the same system at its chaos threshold a = Oc = 1.40115519... for which 
we expect q* = qc = 0.2445.... For this value of a, considerable fluctuations are observed which require an efficient 
and careful averaging over the initial conditions. Consider that the attractor occupies only a tiny part of phase space 
(844 cells out of the W = 10^ of our partition). We adopt the following criterion: we choose the initial distribution 
(made of iV = 10^ points) in one of the W — 10^ cells of the partition and we study the number of occupied cells 
during the time evolution; the integrated number of occupied cells, i.e., the sum of the numbers of occupied cells for 
all time steps from iteration 1 to iteration 50, is a measure of how good this initial condition is at spreading itself. 
We repeat the same study for each one of the T4^/2 cells in the interval < x < 1 and, in fig. 3, we plot the integrated 
number of occupied cells vs. the position of the initial distribution. The cells for which this number is larger than 
a fixed cutoff (= 5000 in fig. 3) are selected for inclusion in the averaging process (in fig. 3 this is 1251 cells, out of a 
total 10^). In fig. 4 we plot Sq{t) for four different values of q ; the curves are an average over the 1251 initial cells 
selected by fig. 3 . The growth of Sq{t) is found to be linear when q ~ qc — 0.2445, while for q < qc {q > qc) the 
curve is concave (convex). This behavior is similar to the one in fig.l, with a major difference: the linear growth is 
not at q = 1 (see inset(a) in fig. 4), but at a particular value of the entropic index, which happens to coincide with 
q* = 0.2445. In order to make this result much more convincing, we fitted the curves Sq(t) in the time interval [ti,t2] 
with the polynomial S{t) = a + 5i + ct^ Q . We define R = \c\ ■ {h + t2)/b as a measure of the importance of 
the nonlinear term in the fit: if the points were on a perfect straight line, R should be zero. We choose ti — 15 and 
t2 — 38 for all q's, so that the factor (<i + is just a normalizing constant. Fig. 4(b) shows the minimum of R for 
q = qc = 0.2445. These results are not sensitive to small changes in ti and ^2- 

Precisely the same behavior, in all of its aspects, that we find here for the standard logistic map has also been 
found recently |l8| for its extended version where the term is generalized into \xt\^ {z e TZ). As expected from 
well known universality class considerations for this family of maps, it was found that q* depends on z. The same 
values for q*{z) were also found fl^ for a periodic family of maps which belongs to the same universality class as the 
logistic-like family. Finally, for the usual logistic map, the value q* — 0.24... was found through a different algorithm 
||19| , closer in fact to the original definition of the Kolmogorov-Sinai entropy. 

To summarize, we have illustrated for the logistic map the connections between the sensitivity to initial conditions, 
the geometrical support in phase space, and the linear growth in time of the entropy Sq. In the case of strong sensitivity 
(exponential divergence between trajectories), the geometrical support is Euclidean, and the relevant entropy with 
linear growth is Si, the usual entropy. In the case of weak sensitivity (power-law divergence), the geometrical support 
is multifractal, and the relevant entropy whose growth is linear is the non-extensive entropy Sq, with a special value 
g* 1 of the entropic index. This q* is the same parameter which enters also in the power-law divergence and in 
the multifractal support: the same q* describes all three phenomena. Thus strong sensitivity and weak sensitivity 
to initial conditions become unified in a single description, the difference residing in the particular value oi q ( ~ 1 
for the strong case). The KS entropy rate, which is an average loss of information, is also indexed by q. We believe 
that the scenario herein exhibited is valid for vast classes of nonlinear dynamical systems, whose full and rigorous 
characterization would be very welcome. We conclude, as a final remark, that the still unclear foundation of statistical 
mechanics on microscopic dynamics seems more than ever to follow along the lines pioneered by Krylov pO| ]. Indeed, 
the crucial concept appears to be the mixing (and not only ergodicity): if the mixing is exponential {strong mixing), 
then q = I and the standard thcrmodynamical extensivity is the adequate hypothesis for those physical phenomena, 
whereas at the edge of chaos the mixing is only algebraic [weak mixing) and then q =/= I and thcrmodynamical 
nonextensivity is expected to emerge. 
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FIG. 1. Time evolution of Sg for a = 2. The interval — 1 < a; < 1 is partitioned into W equal cells. The initial distribution 
consists of N = 10^ points placed at random inside a cell picked at random anywhere on the map. We consider three different 
values of q and the two cases W = and W = 10^. Results are averages over 100 runs. 




FIG. 2. Time evolution of Si for o = 2 and o = 1.6 ; I¥ = 10^ and averages of 100 runs. The slopes of the fits shown are 
respectively equal to the averaged Lyapunov exponents. 
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FIG. 3. Integrated number of occupied cells vs. position of the initial cell. The horizontal line selects the best initial 
conditions (see text). If we increase or decrease the value of this (numerically convenient, but dispensable) cut-off, the value 
for g* remains the same; what changes is the proportionality coefficient between Sq* and time. 
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FIG. 4. Time evolution of Sq for a — ac . We consider four different values of q and W — 10^. The case 5 = 1 is reported 
in the inset (a) with a different scale. Results are averages over 1251 runs. We show the coefficient of nonlinearity R vs. q in 
the inset (b). See text. The 4-digit precision for q* was not attained through the present numerical procedure, but using the 
scaling 1/(1 — g) = 1/amin — 1/amax- The present procedure does not provide higher precision than q* — 0.24.... 
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